Gradient Based Smoothing Parameter Selection for Nonparametric Regression Estimation*

نویسندگان

  • DANIEL J. HENDERSON
  • QI LI
چکیده

Data-driven bandwidth selection based on the gradient of an unknown regression function is considered. Uncovering gradients nonparametrically is of crucial importance across a broad range of economic environments such as determining risk premium or recovering distributions of individual preferences. The procedure developed here is shown to deliver bandwidths which have the optimal rate of convergence for the estimation of gradients. We provide a detailed theoretical account of this new approach to smoothing parameter selection. An important additional advantage of our proposed method over the conventional cross-validation bandwidth selection method is that our approach overcomes the tendency of traditional data-driven approaches to engage in under smoothing. Both simulated and (several) empirical examples showcase the finite sample attraction of this new mechanism. 1. Overview Nonparametric estimation and inferential approaches in applied econometric work are now commonplace. The allure of these methods are that they allow users to mitigate the influence that a specific parametric model places on the analysis and can provide deeper insights into the phenomena of interest relative to their rigid parametric counterparts. Moreover, for conducting policy analysis, the use of nonparametric methods is buttressed by the fact that policy conclusions should hinge on distribution-free methods when knowledge of the true relationship is vacuous (McAfee & Vincent 1992). A key component of any nonparametric (or semiparametric) analysis is the selection of the smoothing (bandwidth) parameter(s) which dictates the behavior of the resulting estimates/inferences. In this paper we develop a novel approach to conduct data-driven bandwidth selection. The motivation for our approach stems from the fact that in applied econometric milieus interest typically hinges on the gradients of the regression function, i.e., marginal effects, rather than the regression State University of New York at Binghamton, Texas A&M University, University of Miami Date: March 28, 2011.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Variable data driven bandwidth choice in nonparametric quantile regression

The choice of a smoothing parameter or bandwidth is crucial when applying nonparametric regression estimators. In nonparametric mean regression various methods for bandwidth selection exists. But in nonparametric quantile regression bandwidth choice is still an unsolved problem. In this paper a selection procedure for local varying bandwidths based on the asymptotic mean squared error (MSE) of ...

متن کامل

Two-step Smoothing Estimation of the Time-variant Parameter with Application to Temperature Data

‎In this article‎, ‎we develop two nonparametric smoothing estimators for parameter of a time-variant parametric model‎. ‎This parameter can be from any parametric family or from any parametric or semi-parametric regression model‎. ‎Estimation is based on a two-step procedure‎, ‎in which we first get the raw estimate of the parameter at a set of disjoint time...

متن کامل

Automatic Generalized Nonparametric Regression via Maximum Likelihood

A relatively recent development in nonparametric regression is the representation of spline-based smoothers as mixed model fits. In particular, generalized nonparametric regression (e.g. smoothingwith a binary response) corresponds to fitting a generalized linear mixedmodel. Automation, or data-driven smoothing parameter selection, can be achieved via (restricted) maximum likelihood estimation ...

متن کامل

A MODIFICATION ON RIDGE ESTIMATION FOR FUZZY NONPARAMETRIC REGRESSION

This paper deals with ridge estimation of fuzzy nonparametric regression models using triangular fuzzy numbers. This estimation method is obtained by implementing ridge regression learning algorithm in the La- grangian dual space. The distance measure for fuzzy numbers that suggested by Diamond is used and the local linear smoothing technique with the cross- validation procedure for selecting t...

متن کامل

How Far Are Automatically Chosen Regression Smoothing Parameters from Their Optimum?

· ABSTRACT In the setting of nonparametric curve estimation the problem of smoothing parameter selection is addressed. The deviation between the the squared error optimal smoothing parameter and the smoothing parameters provided by a number of automatic selection methods is studied both theoretically and by simUlation. The theoretical results include a central limit theorem which shows both the...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2011